
Fig. 2 




Fig. 4 




" R ef e ren ce- w h ite 
Cone & Window" 
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Fig. 6C 



Fig. 6D 




Fig. 7C 



Fig. 7D 




Fig. 8 



# 




Fig. 9C 




Fig. 10 



Check availability and integrity of database 

Check system date, CD recorder and camera controller 

Instruct user to calibrate camera (see Figs. 19 & 22) 


^ zo 1 
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Top level menu: offer the user a choice of the following options: 


1 






i 


1 Obtain live view (not saveable) 




Add a nev^ patient folder to the database (see Fig. 15) 


r 


Find and open an existing patient record(see Fig. 16) 


r 



Administration functions (see Figs. 20 and 21) 



Fig. 11 
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Prompt user for patient details 



Accept patient details, validate data 



If patient not already in database, then 
Create new patient record in database 
Enter patient data in record 

Else if match for patient found, then 

Check with user if a new record is required 
Yes: create as above and proceed 
No: return to top level menu 

1 =— 

Make new patient record current 



User identifies patient from list of all patients 
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System retrieves patient record and displays patient data 
System selects first (default) bodymap as current map 



293 



Display current map 
If default bodymap is current, mark positions of any existing photomaps 
Mark any existing' lesion sites on current map 
Select first lesion site on current map as current lesion site 
Lesion images are displayed (see Fig 1 7 A) 



I In this state the user may select any of following actions: 
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I Add to record: | 



Photomap (if Use-Photomap menu option enabled) \ 
Lesion site on current map | 
Lesion image (on current lesion site if one exists) | 



HScrolI through or select:| 



Maps (if any photomaps exist) 
Lesion images are displayed (see Fig 17A) 
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"■^"► j Lesion sites on current map (if more than 2 lesion sites exist) | 



Lesion images tor current lesion site, in Photo A or Photo B 



^-Manipulate images 



Tile lesion images if more than one exist | 



Zoom image^see Fig I7B| 



^Administration menu items (see Figs. 20 and 21) 



» | Close patient record (see Fig 13) 



If there is at least one image for that lesion site then 
display the latest image for that site in Photo B. 



If there is more than one image for that lesion site then 
display the first image for that site in Photo A. 



Fig. 17A 



Select image out of map. Photo A and Photo B 



Click on zoom button to allow image to be enlarged to fill screen 
Any of the following options may then be selected: 








1 Perform on-screen distance measurements | 

r 


1 Enable grid overlay 


[Terminate zoom state by clicking on the "Cancel" button 



Fig. 17B 



If reference- white image has not been taken for this session and this patient: 

Verify new "per-use" cone in place 

Take the reference-white image 

Check if reference-white image is acceptible 

Save reference-white image to disk 
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User takes image ot skm adjacent lo lesion 

Display skin image on the computer monitor, with option of "zoom image'' 



j Is skin image satisfactory? j , 



No 



Yes 



User takes image of lesion 

If previous image of lesion exists: 

Optional "overlay" of previous lesion image for alignment 
Display lesion image on the computer monitor, with option of "zoom image" 



3o: 



I Is lesion image satisfactory? 1 



No 



1 


Yes 

r 


System writes the two images to disk 

System updates the patient information in the database 
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Fig. 18 



Take and discard a small number of images to allow system to stabilise 
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Take an image 



i. 



Calculate mean and standard deviation for all colour channels 



J. 



Check that standard deviations are within permitted limits 
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NOK 



OK 



Check that differences in means between all channels are less than permitted Units NOK 




OK 



Check that means are within permitted limits 



OK 




NOK 



Save reference-white image to disk; update patient Record 



Done 



Instruct user to perform full camera calibration 
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Show picture of reference-white cone on screen, 

instruct user to attach reference-white cone to hand-held unit, 

and return to first step 



Fig. 19 
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•s 



User may select the following options from this screen 



File operations: 



J J 1 



Archive images to CD 



Print a report with 



Current map with lesion sites marked 



Current photo B (large size) 



Current photos A and B (smaller size) 



Edit: (subject to correct entry of password) 
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Workstation (i.e., database) info 



Patient details and clinical notes 



Photomap location 



Lesion location, information and status 



Mark as deleted any of the following from the database 
(subject to correct entry of password) 



n ^ c 



Patient 



Photomap 



Lesion 



Image 



Remove deletion mark from any of the following 
(subject to correct entr y of password) 
5 



337 



Patient 



All deleted data of the current patient j 



I Last deletion 



Other Options (see Fig. 21) 



Fig. 20 



Other Options menu 



Use Photomaps 



Use Overlaying 



Allow Multiple Adding 



Camera calibration: 



White I 



Black and White 



Reset 
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Ga uma correction (on/off) for: 



Lesion images 



Photomap images 
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345 



347 



351 



Fig. 21 







c^at mm*=»ra ^nc\ frame ffrahhers oarameters to startins values 




1 * ^ u-Tn i 1 ^ 361 




jlnstruct user to remove any cones and put baiile over lens 




^ 363 
1 Instruct camera controller to perform ABB 
1 ^ 




ArliiTc:t fr;imp arahher 7ero to eive averaee ima2e briizhtness ot about 4% 




of the fiill dvnamic ranee 




1 p 




|Instruct user to replace baffle with reference-white cone 




1 

[Instruct camera controller to perform AWB 




Tn^stmrt rampra controller to oertorm SHE) -"^""^ 
i 




Ramp up camera controller gain until average image brightness near desired level - 


i 


|Ramp up/down frame grabber gain until average image brightness at desired level 




1 (optional) Adjust frame grabber red and blue gains to balance channel intensities 


Retain good reference-white image 



Fig. 22 



Correct for Black lev el and normalise/calibrate skin iinage(s) and lesion image 

i 



In skin image locate boundaries of target(s) if present 



In skin image check colour of targets if present 



In skin image detect hairs and create mask 



T 



In skin image detect bubbles and create mask 



Analyse skin image for skin colour 



I In lesion image detect and create mask for hairs and bubbles 



In lesion image separate skin and lesion areas 



T 



In lesion image reduce colour space into colour bins 



Further analysis of lesion using prior art techniques 



Format results and display 
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405 
407 
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411 
413 
415 
417 
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421 



Histogram of image briglitness 




Brightness 

Fig. 24A 




Brightness 



Fig. 24B 




Fig. 26C 



